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ABSTRACT 

. , . Norm graphs are given for the purpose of aidinq in 

the comparison of students of one school with those of another school 
with regard to scholastic ability, achievement, and school size! ' 



1 



UNIVERSITy OF ILLINOIS " S''ol''cAT^?^r;V.?fp*r"- 

^ ^ _ ^- • * - NATIONAL INSTITUTE OF 

vO Center for Instructional Research eoucation . 

^1 THIS DOCUMENT HAS BEEN «EPfi!0 

CVl and Curriculum Evaluation ouceo EXACTLy as received from 

^ OfA r»J- T> j^<ij IhE PERSON OR ORGANIZATION ORIGIN 

270 Education Building ating.t points op view o«? opinions 

Or^ It . STATED 00 NOT NECESSARILY REPRE 

Urbana, Illinois 61801 sent official national institute of 

o 



education position or policy 



en 



o 



1972-73 ILLINOIS STATEWIDE HIGH SCHOOL T23TING PROGHAM 

SCHOOL NORMS 



The norm graphs enclosed herewith are intended to help you answer questions such 
as the following: 

li How do our students compare with students in other schools in the 
state in regard to their scholastic ability and to their achievement? 

2. How do our students compare in scholastic ability and achievement in 
the basic skills with students In other schools of similar size? 

QQ 3. How does the level of achievement in the basic skills for oiir 

students compare with students of approximately equal acadcunic 
O ability? 

4, How does our school » if it is a private school, compare with respect 
CO to academic ability and achievement with other private schools in 

the Program? 



The Oreanization of the Norm. Data 

The mead percentile was computed on each test for every junior or senior class. 
This mean percentile is the percentile which corresponds to the mean raw score. 
The mean raw score is an arithmetic average — that is, the total of the raw scores 
divided by the number of scores. The norm data following are based on these 
average percentiles. Norms were prepared as a series o£ twelve graphs, copies of 
which are attached. ^ 

The results for seniors are tabulated only in one way — all schools testing seniors 
(Graph 12). Further tabulations for the seniors were not practicable because the 
groups would have been too small to be representative. In the senior norms we 
used only those schools which tested ten or more seniors. This limitation 
excludes those schools which "picked up" only a very few seniors for special 
testing. Such schools obviously would hot be representative and therefore not a 
reliable basis for norms. 

The results for the junior class were tabulated as a group (Graph 1) and also by 
subgroups as follows: 
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JUNIORS 



All Schools^ 
Graph, 



Subdivided 
by 

Public-Private 

Private Schools 
Graph 2 



Graph 3 
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0-99 
Graph 4 


100-299 
Graph 5 


300-499 
Graph ^6 




500-999 
Graph 7 


1000+ 
Graph 8 



Subdivided 
by 

Total DAT Average 



Top Quarter 
Graph 9 

Middle Half 
Graph 10 

Lowest Quarter 
Graph 11 



How Do I Find the Norm Scores for My School? 

All schools will find it possible and to their advi^tage to make several norm 
compifisons of their results* Schools may compare their results with the norms 
(1) for all schools » (2) for public or private schools » i3) for schools with 
students of similar average academic ability » and (4) with schools of comparable 
size (only public schools testing juniors)* For instance^ suppose your juniors 
received a mean percentile score of 50 on the Problem Solving scores of the 
Mathematics Test. In Graph 1 the Problem Solving norms are given by the vertical 
box and line at the right-hand side of the graph. Because 50 falls in the lower 
half of the vertical box^ we can say that the percentile mean for your school 
exceeds more than 25 percent (but not as many as 50 percent) of the percentile 
mean scores of all the schools tested. Referring to Graph 3 for juniors from 
the public schools only, we find that a mean of 50 falls in the lower half of 
the vertical box. Your juniors* average is Higher than 25 percent of the junior 
averages in other Illinois public schools in the Program. 

Now suppose that your school's D.A.T. Verbal Reasoning score were in the lowest 
quarter for all schools. Then Graph 11 would be used to determine the achievement 
of these students relative to that of. others of comparable learning ability. We 
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find that 50 on Problem Solving falls near the top of the vertical box. Your 
juniors are scoring better than almost 75 percent of the junior classes of com- 
parable learning ability. 

Lastly, suppose that the total enrollment of your school is between 300 and 499. 
We find in Graph 6 that 50 falls at the first quartile point. This would mean 
that, compared with schools of its size, your school mean exceeded more than 25 
percent of the mean percentile scores of such schools. 



How Do I Compare Test Results within my School? 

Now that you have the school norms, it may be well worth your time to read over 
Chapter VI of the A ids to Interpretation ^ which was sent to you earlier. This 
chapter deals with, the analysis of group results. 

The nine Program test scores can be divided ^oughly into one measure of learning 
aBiiity (p Verbal Reasoning) and eight ideas^^ achievement 
(Natural Sclenc^^^ Social Stales i thr^ skills scores ^ and three 

mathematics skiils scores) i As pbinted; out in Mds to Ihte^ (page 16) , 

cpiparisons between arid within these types of scores are ti^^^ studying 
individual profiles, they are also useful for studying the mean scores of your 
school. 

Quite high or quite low differences between the Natural Sciences or Social 
Studies test scores in relation to the D.A.T. scores, are frequently indicative 
of the relative strength of the prograias In these two areas. For exami:le, a lack 
of training in elementary and general science seems to lower the Natural Sciences 
test score. Thus, these readihg^^comprehension scores must be thought of as 
related to both reading and subject-matter 'competence. 

Differences between Gramar and Usage scores in the English Test can. raise 
questions about the curriculum in communications-skills training. For a clearer 
explanation of what these scores mean, see^Mds to Interpretation (pages 4 and 
5). Differences between Problem Solving and Mathematics Reasdhing scores in the 
Mathematics Test can raise questions about the curriculum in mathematics. For a 
clearer explanation of what these scores mean, see Aids to Interpretation (pages 
5 and 6). 



How Good Are Our Results? 

The terms "good" and "bad" connote a value judgment that norms can never make. 
In themselves, these norms are descriptive only of the average achievement of 
schools in the Program and not of what is a satisfactory standard. Indeed, 
judging frqm the comment of the critics of today's schools, academic achievement 
is falling far short of any "satisfactory standards." Since there is always room 
to Improve, in one sense the levels set by norms are always "unsatisfactory." On 
the other hand, norms do indicate the levels of achievement which actually are 
being attained by other schools and, other things being equal, do represent real- 
istic and obtainable levels of achievement. Schools probably will want to take 
this fact into account in setting their own standards. 
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But suppose, for example, that the mean for your school falls in the lower middle 
quarter on the Natural Sciences Test . This fact alone does not mean that you 
must or should put more emphasis on these particular skills. First, you need to 
look at other facts, such as how your pupils compare with other schools on the 
D.A.T. Verbal Reasoning score. Obviously, the low Natural Sciences scores will 
mean something different if your pupils are comparatively low on the D.A.T. 
Verbal Reasoning than it will if they are quite high on that test. 

You should also examine the skills tested by the Natural Sciences Test and ask 
whether or not more emphasis on them is appropriate and where it would fit your 
curriculum. The basic skills represented in these tests are not: "taught by one 
content area alone~i.e., reading or communication skills such as these probably 
are not well learned if taught otay in English classes. These skills are general 
ones in which nearly all subject-matter areas are interested. It may well be 
true that efforts to correct we^esses can only be undertaken at the expense of 
certaih other objectives. Each school must decide how high it shall set its 
sights aiid what shall be e^^^ Remember ^ however, not all schools can 

stands above average oh all distributions! 

How Do i Know What Performance Levels on These Tests Are Satisf actory for My School? 

You can best determine what constitutes a satisfactory level of performance by 
actuaiiy looking at the tests themselves. The specimen sets sent with the Manual 
of Instructions were to be retained by you. If these are riot now available, we 
will send others upon request. Since we have reported both the raw scores and 
the percentile scores this year, you know the number of correct answers the 
student: must have marked in order to receive a particular percentile. The mean 
raw score gives you an indication of the average number of correct answers marked 
by the students in your school. By looking at the test questions and noting the 
number* of questions the student must have anwered correctly in order to get the 
average percentile rank of your school, you can estimate the kind of performance 
this must represent. 

Distributing the Results to Your Faculty 

On page 6 is a record sheet which suggests one way of presenting the profile 
results for your school. Many schools have found it convenient to complete this 
form and make duplicate copies of it for distribution to those interested. If 
these data are to form the basis for decision about your curriculimi, you may want 
to give the results wide distribution among your faculty. You can quickly fill 
in the charts by making an "X" in the appropriate box in each column. For example, 
suppose that the mean for your juniors on Verbal Reasoning is 52. From Graph 1 
you find that 52 falls in the upper middle quarter. Therefore, you would make 
an "X" in the Upper Middle box of the VR column in the top chart on page 6. 

icicicicit'kiiicjkicit 



ERLC 



yrom year to year a number of s chools have asked if other schools have tested all 
juniors. This is a good .test ion since the comparison value of these norms would 
be distinctly different if any considerable number of schools tested some selected 
sample » e.g., college curripulum only^ bottom-half students » only students who 
want the tests. Our answer to this question over the years has been that by our 
observations of school size and number of juniors tested we are convinced that 
virtually all schools test all of their juniors. Each year we have known of one 
or two which did not test all of the juniors, and we have pulled these from our 
norm data. This year ^e again asked each school expilicitly whether or not-^ it ■ ■ 
tested all juniors. It turned out that only six schools did not test all 
juniors, and we did not Include these schools in our school norms. In other 
words, when you use these norms to compare your school with^^a sch" >1 of like 
size, you are not comparing your students with some select group from schools of 
that size. 



Hov do we compare with all the other schools in the state? 
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How do we compare with other schools of our size? 
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How do we compare with other schools who have students with the same general 
range of learning ability in terms of achievement in the basic skills? 
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GRAPH 1 
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Norms established on 309 schools 



How to Interpret 
Each Bar in the Graphs 
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Juniors 
Public Schools Only 
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Norms established on 29 schools 



Norms established on 280 schools 
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GRAPH 5 



Juniors 
PublLc Schools Only 
Total Enrollaent 99 or Less 
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Juniots 
Public Schools Only 
Total Enrollment 100-299 
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Norms established on 16 schools 
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GRAPH 7 



! Juniors 

\ Public Schools Only 

' Total Enrollment 300-499 
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Junlors 
Public Schools Only 
Total Enrollment 500-999 
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worms established on 48 schools 



Horms established on 37 schools 
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Juniors 

All Schools in Prograa in Top (flatter 
on DAT Verbal Score (64-86) 
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GRAPH 11 



Juniors 

Ali Schools in Program in Iliddle Half 
on DAT Verbal Score (47-52) 
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Juniors ; 
All Schools in Program in Lowest Quarter I 
on DAT Verbal Score (18-33) 
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Itorms established on 77 schools 



The follox/ing sets of figures represent exactly the sanie things the foregoins 
graphs shou. lU simply have tabled here the follwins values frr each norm graph 
line 

1. The high point on the graph line — this is the top average aade by 
any school in that norm classification. 

2. The third quart ile point— this is the percentile value i^hich is 

indicated by the top line of the vertical box in the graph. 

3. The median point — this is the value represented by the horizontal 
line within the vertical box. 

4. The first quartile point— this represents the percentile value for 
the bottom line of the vertical box:*. 

5* The loi7 point — this represents the loi^est average made by any school ^ 
or the point v/hich is the louer extremity of the graph line. 

6. The mean point — this is the percentile equivalent of the mean tofj 
score and is indicated by the *'x" in the vertical box. 

These tables are nuiid)ered exactly as the graphs are numbered. 
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